The LEADING Guideline: Reporting Standards for Expert Panel, Best-Estimate Diagnosis, and Longitudinal Expert All Data (LEAD) Studies.

Accurate assessments of symptoms and diagnoses are essential for health research and clinical practice but face many challenges. The absence of a single error-free measure is currently addressed by assessment methods involving experts reviewing several sources of information to achieve a more accurate or best-estimate assessment. Three bodies of work spanning medicine, psychiatry, and psychology propose similar assessment methods: The Expert Panel, the Best-Estimate Diagnosis, and the Longitudinal Expert All Data (LEAD). However, the quality of such best-estimate assessments is typically very difficult to evaluate due to poor reporting of the assessment methods and when it is reported, the reporting quality varies substantially. Here we tackle this gap by developing reporting guidelines for such studies, using a four-stage approach: 1) drafting reporting standards accompanied by rationales and empirical evidence, which were further developed with a patient organization for depression, 2) incorporating expert feedback through a two-round Delphi procedure, 3) refining the guideline based on an expert consensus meeting, and 4) testing the guideline by i) having two researchers test it and ii) using it to examine the extent previously published articles report the standards. The last step also demonstrates the need for the guideline: 18 to 58% (Mean = 33%) of the standards were not reported across fifteen randomly selected studies. The LEADING guideline comprises 20 reporting standards related to four groups: The Longitudinal design; the Appropriate data; the Evaluation - experts, materials, and procedures; and the Validity group. We hope that the LEADING guideline will be useful in assisting researchers in planning, reporting, and evaluating research aiming to achieve best-estimate assessments.

Heterogeneity of outcome measures in depression trials and the relevance of the content of outcome measures to patients: a systematic review.

Research waste occurs when randomised controlled trial (RCT) outcomes are heterogeneous or overlook domains that matter to patients (eg, relating to symptoms or functions). In this systematic review, we reviewed the outcome measures used in 450 RCTs of adult unipolar and bipolar depression registered between 2018 and 2022 and identified 388 different measures. 40% of the RCTs used the same measure (Hamilton Depression Rating Scale [HAMD]). Patients and clinicians matched each item within the 25 most frequently used measures with 80 previously identified domains of depression that matter to patients. Seven (9%) domains were not covered by the 25 most frequently used outcome measures (eg, mental pain and irritability). The HAMD covered a maximum of 47 (59%) of the 80 domains that matter to patients. An interim solution to facilitate evidence synthesis before a core outcome set is developed would be to use the most common measures and choose complementary scales to optimise domain coverage. TRANSLATIONS: For the French and Dutch translations of the abstract see Supplementary Materials section.

A Network Study of Family Affect Systems in Daily Life.

Adolescence is a time period characterized by extremes in affect and increasing prevalence of mental health problems. Prior studies have illustrated how affect states of adolescents are related to interactions with parents. However, it remains unclear how affect states among family triads, that is adolescents and their parents, are related in daily life. This study investigated affect state dynamics (happy, sad, relaxed, and irritated) of 60 family triads, including 60 adolescents (Mage = 15.92, 63.3% females), fathers and mothers (Mage = 49.16). The families participated in the RE-PAIR study, where they reported their affect states in four ecological momentary assessments per day for 14 days. First, we used multilevel vector-autoregressive network models to estimate affect dynamics across all families, and for each family individually. Resulting models elucidated how family affect states were related at the same moment, and over time. We identified relations from parents to adolescents and vice versa, while considering family variation in these relations. Second, we evaluated the statistical performance of the network model via a simulation study, varying the percentage missing data, the number of families, and the number of time points. We conclude with substantive and statistical recommendations for future research on family affect dynamics.

Introducing FRED: Software for Generating Feedback Reports for Ecological Momentary Assessment Data.

Ecological Momentary Assessment (EMA) is a data collection approach utilizing smartphone applications or wearable devices to gather insights into daily life. EMA has advantages over traditional surveys, such as increasing ecological validity. However, especially prolonged data collection can burden participants by disrupting their everyday activities. Consequently, EMA studies can have comparably high rates of missing data and face problems of compliance. Giving participants access to their data via accessible feedback reports, as seen in citizen science initiatives, may increase participant motivation. Existing frameworks to generate such reports focus on single individuals in clinical settings and do not scale well to large datasets. Here, we introduce FRED (Feedback Reports on EMA Data) to tackle the challenge of providing personalized reports to many participants. FRED is an interactive online tool in which participants can explore their own personalized data reports. We showcase FRED using data from the WARN-D study, where 867 participants were queried for 85 consecutive days with four daily and one weekly survey, resulting in up to 352 observations per participant. FRED includes descriptive statistics, time-series visualizations, and network analyses on selected EMA variables. Participants can access the reports online as part of a Shiny app, developed via the R programming language. We make the code and infrastructure of FRED available in the hope that it will be useful for both research and clinical settings, given that it can be flexibly adapted to the needs of other projects with the goal of generating personalized data reports.

A narrative systematic review of changes in mental health symptoms from before to during the COVID-19 pandemic.

The onset of the COVID-19 pandemic raised concerns regarding population-wide impacts on mental health. Existing work on the psychological impacts of disaster has identified the potential for multiple response trajectories, with resilience as likely as the development of chronic psychopathology. Early reviews of mental health during the pandemic suggested elevated prevalence rates of multiple forms of psychopathology, but were limited by largely cross-sectional approaches. We conducted a systematic review of studies that prospectively assessed pre- to peri-pandemic changes in symptoms of psychopathology to investigate potential mental health changes associated with the onset of the pandemic (PROSPERO #CRD42021255042). A total of 97 studies were included, covering symptom clusters including obsessive-compulsive disorder (OCD), post-traumatic stress disorder (PTSD), fear, anxiety, depression, and general distress. Changes in psychopathology symptoms varied by symptom dimension and sample characteristics. OCD, anxiety, depression, and general distress symptoms tended to increase from pre- to peri-pandemic. An increase in fear was limited to medically vulnerable participants, and findings for PTSD were mixed. Pre-existing mental health diagnoses unexpectedly were not associated with symptom exacerbation, except in the case of OCD. Young people generally showed the most marked symptom increases, although this pattern was reversed in some samples. Women in middle adulthood in particular demonstrated a considerable increase in anxiety and depression. We conclude that mental health responding during the pandemic varied as a function of both symptom cluster and sample characteristics. Variability in responding should therefore be a key consideration guiding future research and intervention.

Elemental psychopathology: distilling constituent symptoms and patterns of repetition in the diagnostic criteria of the DSM-5.

BACKGROUND: The DSM-5 features hundreds of diagnoses comprising a multitude of symptoms, and there is considerable repetition in the symptoms among diagnoses. This repetition undermines what we can learn from studying individual diagnostic constructs because it can obscure both disorder- and symptom-specific signals. However, these lost opportunities are currently veiled because symptom repetition in the DSM-5 has not been quantified. METHOD: This descriptive study mapped the repetition among the 1419 symptoms described in 202 diagnoses of adult psychopathology in section II of the DSM-5. Over a million possible symptom comparisons needed to be conducted, for which we used both qualitative content coding and natural language processing. RESULTS: In total, we identified 628 distinct symptoms: 397 symptoms (63.2%) were unique to a single diagnosis, whereas 231 symptoms (36.8%) repeated across multiple diagnoses a total of 1022 times (median 3 times per symptom; range 2-22). Some chapters had more repetition than others: For example, every symptom of every diagnosis in the bipolar and related disorders chapter was repeated in other chapters, but there was no repetition for any symptoms of any diagnoses in the elimination disorders, gender dysphoria or paraphilic disorders. The most frequently repeated symptoms included insomnia, difficulty concentrating, and irritability - listed in 22, 17 and 16 diagnoses, respectively. Notably, the top 15 most frequently repeating diagnostic criteria were dominated by symptoms of major depressive disorder. CONCLUSION: Overall, our findings lay the foundation for a better understanding of the extent and potential consequences of symptom overlap.

Principles and procedures for revising the hierarchical taxonomy of psychopathology.

Quantitative, empirical approaches to establishing the structure of psychopathology hold promise to improve on traditional psychiatric classification systems. The Hierarchical Taxonomy of Psychopathology (HiTOP) is a framework that summarizes the substantial and growing body of quantitative evidence on the structure of psychopathology. To achieve its aims, HiTOP must incorporate emerging research in a systematic, ongoing fashion. In this article, we describe the historical context and grounding of the principles and procedures for revising the HiTOP framework. Informed by strengths and shortcomings of previous classification systems, the proposed revisions protocol is a formalized system focused around three pillars: (a) prioritizing systematic evaluation of quantitative evidence by a set of transparent criteria and processes, (b) balancing stability with flexibility, and (c) promoting inclusion over gatekeeping in all aspects of the process. We detail how the revisions protocol will be applied in practice, including the scientific and administrative aspects of the process. Additionally, we describe areas of the HiTOP structure that will be a focus of early revisions and outline challenges for the revisions protocol moving forward. The proposed revisions protocol is designed to ensure that the HiTOP framework reflects the current state of scientific knowledge on the structure of psychopathology and fulfils its potential to advance clinical research and practice. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Suicidal ideation across depressive episodes: 9-year longitudinal cohort study.

BACKGROUND: Depression is a highly recurrent disorder, with more than 50% of those affected experiencing a subsequent episode. Although there is relatively little stability in symptoms across episodes, some evidence indicates that suicidal ideation may be an exception. However, these findings warrant replication, especially over longer periods and across multiple episodes. AIMS: To assess the relative stability of suicidal ideation in comparison with other non-core depressive symptoms across episodes. METHOD: We examined 490 individuals with current major depressive disorder (MDD) at baseline and at least one subsequent episode during 9-year follow-up within the Netherlands Study of Depression and Anxiety (NESDA). The Inventory of Depressive Symptomatology (IDS) was used to assess DSM-5 non-core MDD symptoms (fatigue, appetite/weight change, sleep disturbance, psychomotor disturbance, concentration difficulties, worthlessness/guilt, suicidal ideation) at baseline and 2-, 4-, 6- and 9-year follow-up. We examined consistency in symptom presentation (i.e. whether the symptom met the diagnostic threshold, based on a binary categorisation of the IDS) using kappa (κ) and percentage agreement, and stability in symptom severity using Spearman correlation, based on the continuous IDS scores. RESULTS: Out of all non-core depressive symptoms, insomnia appeared the most stable across episodes (r = 0.55-0.69, κ = 0.31-0.47) and weight decrease the least stable (r = 0.03-0.33, κ = 0.06-0.19). For suicidal ideation, correlations across episodes ranged from r = 0.36 to r = 0.55 and consistency ranged from κ = 0.28 to κ = 0.49. CONCLUSIONS: Suicidal ideation is moderately stable in recurrent depression over 9 years. Contrary to prior reports, however, it does not exhibit substantially more stability than most other non-core symptoms of depression.

Studying fine-grained elements of psychopathology to advance mental health science.

Given the now well-recognized limitations of traditional classification systems for research, this editorial proposes to advance mental health science by focusing research efforts on studying fine-grained elements of mental health and illness such as symptoms, mechanisms, and processes. Our own perspectives are informed by three approaches in particular that have gained traction over the last decade: the Hierarchical Taxonomy of Psychopathology, the network or systems approach, and the National Institute of Mental Health Research Domain Criteria. Drawing on these and other perspectives as well as the diverse views of the author teams that contributed to this Special Section, we summarize the state of the field and propose an ambitious plan for the way ahead. Specifically, we propose that embracing pluralistic, multimethod, and multisystem approaches offers a way forward. This will require strategies to reduce research waste and much stronger channels for communication to identify confluence, discoveries, and dead ends within and between disciplines. We are optimistic this will lead to a better understanding of the mechanisms underpinning psychopathology and ultimately to more effective interventions. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

History repeating: guidelines to address common problems in psychedelic science.

Research in the last decade has expressed considerable optimism about the clinical potential of psychedelics for the treatment of mental disorders. This optimism is reflected in an increase in research papers, investments by pharmaceutical companies, patents, media coverage, as well as political and legislative changes. However, psychedelic science is facing serious challenges that threaten the validity of core findings and raise doubt regarding clinical efficacy and safety. In this paper, we introduce the 10 most pressing challenges, grouped into easy, moderate, and hard problems. We show how these problems threaten internal validity (treatment effects are due to factors unrelated to the treatment), external validity (lack of generalizability), construct validity (unclear working mechanism), or statistical conclusion validity (conclusions do not follow from the data and methods). These problems tend to co-occur in psychedelic studies, limiting conclusions that can be drawn about the safety and efficacy of psychedelic therapy. We provide a roadmap for tackling these challenges and share a checklist that researchers, journalists, funders, policymakers, and other stakeholders can use to assess the quality of psychedelic science. Addressing today's problems is necessary to find out whether the optimism regarding the therapeutic potential of psychedelics has been warranted and to avoid history repeating itself.

Using network models to explore the associations between posttraumatic stress disorder symptoms and subjective cognitive functioning.

Several studies have identified relationships between posttraumatic stress disorder (PTSD) and cognitive functioning. Here, we aimed to elucidate the nature of this relationship by investigating cross-sectional associations between subjective cognitive functioning (SCF) and 1) the PTSD sum score, 2) symptom domains, and 3) individual symptoms. We also investigated temporal stability by testing whether results replicated over a 3-year period. We estimated partial correlation networks of DSM-5 PTSD symptoms (at baseline) and SCF (at baseline and follow-up, respectively), using data from the National Health and Resilience in Veterans Study (NHRVS; N = 1484; Mdn = 65 years). The PTSD sum score was negatively associated with SCF. SCF was consistently negatively associated with the PTSD symptom domains 'marked alterations in arousal and reactivity' and 'negative alterations in cognitions and mood', and showed robust relations with the specific symptoms 'having difficulty concentrating' and 'trouble experiencing positive feelings'. Results largely replicated at the 3-year follow-up, suggesting that some PTSD symptoms both temporally precede and are statistically associated with the development or maintenance of reduced SCF. We discuss the importance of examining links between specific PTSD domains and symptoms with SCF-relations obfuscated by focusing on PTSD diagnoses or sum scores-as well as investigating mechanisms underlying these relations. Registration Number: 37069 (https://aspredicted.org/n5sw7.pdf).

Quantifying skip-out information loss when assessing major depression symptoms.

Large-scale mental health surveys screen participants for the presence of the core diagnostic criteria of a mental disorder such as major depressive disorder (MDD). Only participants who screen positive are administered the full diagnostic module; the remainder "skip-out." Although this procedure adheres faithfully to the psychiatric classification of mental disorders, it limits the use of the resulting survey data for conducting high-quality research of importance to scientists, clinicians, and policymakers. Here, we conduct a series of exploratory analyses using the Virginia Adult Twin Study of Psychiatric and Substance Use Disorders (VATSPSUD) data, a unique survey which suspended the skip-out procedure for assessing past-year MDD. Adult twins (N = 8,980) born between 1930 and 1974 were recruited from a multiple-birth record database established in 1980 and interviewed in mid-adulthood between 1987 and 1996. We compared the: (a) prevalence and levels of impairment of the diagnostic criteria (and disaggregated symptom items) of adults screening positive/negative and (b) patterns of associations between MDD diagnostic criteria (and disaggregated symptom items) under three conditions: (a) full data; (b) "skip-out" data substituted with zeros; and (c) "skip-out" data treated via listwise deletion. Important differences in the patterns of associations between diagnostic criteria and disaggregated symptom sets emerged which changed the statistical evidence regarding the dimensionality of the criteria/symptom items (i.e., Condition C). An ill-defined correlation matrix which was unsuitable for statistical analysis was produced (i.e., Condition B). Given the problems with these widely used approaches, we offer researchers and data analysts practical alternatives to using the skip-out procedure in future surveys. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Reporting standards for psychological network analyses in cross-sectional data.

Statistical network models describing multivariate dependency structures in psychological data have gained increasing popularity. Such comparably novel statistical techniques require specific guidelines to make them accessible to the research community. So far, researchers have provided tutorials guiding the estimation of networks and their accuracy. However, there is currently little guidance in determining what parts of the analyses and results should be documented in a scientific report. A lack of such reporting standards may foster researcher degrees of freedom and could provide fertile ground for questionable reporting practices. Here, we introduce reporting standards for network analyses in cross-sectional data, along with a tutorial and two examples. The presented guidelines are aimed at researchers as well as the broader scientific community, such as reviewers and journal editors evaluating scientific work. We conclude by discussing how the network literature specifically can benefit from such guidelines for reporting and transparency. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Building an Early Warning System for Depression: Rationale, Objectives, and Methods of the WARN-D Study.

Background: Depression is common, debilitating, often chronic, and affects young people disproportionately. Given that only 50% of patients improve under initial treatment, experts agree that prevention is the most effective way to change depression's global disease burden. The biggest barrier to successful prevention is to identify individuals at risk for depression in the near future. To close this gap, this protocol paper introduces the WARN-D study, our effort to build a personalized early warning system for depression. Method: To develop the system, we follow around 2,000 students over 2 years. Stage 1 comprises an extensive baseline assessment in which we collect a broad set of predictors for depression. Stage 2 lasts 3 months and zooms into participants' daily experiences that may predict depression; we use smartwatches to collect digital phenotype data such as sleep and activity, and we use a smartphone app to query participants about their experiences 4 times a day and once every Sunday. In Stage 3, we follow participants for 21 months, assessing transdiagnostic outcomes (including stress, functional impairment, anxiety, and depression) as well as additional predictors for future depression every 3 months. Collected data will be utilized to build a personalized prediction model for depression onset. Discussion: Overall, WARN-D will function similarly to a weather forecast, with the core difference that one can only seek shelter from a thunderstorm and clean up afterwards, while depression may be successfully prevented before it occurs.

A clinical PREMISE for personalized models: Toward a formal integration of case formulations and statistical networks.

Over the past decade, the idiographic approach has received significant attention in clinical psychology, incentivizing the development of novel approaches to estimate statistical models, such as personalized networks. Although the notion of such networks aligns well with the way clinicians think and reason, there are currently several barriers to implementation that limit their clinical utility. To address these issues, we introduce the Prior Elicitation Module for Idiographic System Estimation (PREMISE), a novel approach that formally integrates case formulations with personalized network estimation via prior elicitation and Bayesian inference. PREMISE tackles current implementation barriers of personalized networks; incorporating clinical information into personalized network estimation systematically allows theoretical and data-driven integration, supporting clinician and patient collaboration when building a dynamic understanding of the patient's psychopathology. To illustrate its potential, we estimate clinically informed networks for a patient suffering from obsessive-compulsive disorder. We discuss open challenges in selecting statistical models for PREMISE, as well as specific future directions for clinical implementation. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Quantifying and addressing the impact of measurement error in network models.

Network psychometric models are often estimated using a single indicator for each node in the network, thus failing to consider potential measurement error. In this study, we investigate the impact of measurement error on cross-sectional network models. First, we conduct a simulation study to evaluate the performance of models based on single indicators as well as models that utilize information from multiple indicators per node, including average scores, factor scores, and latent variables. Our results demonstrate that measurement error impairs the reliability and performance of network models, especially when using single indicators. The reliability and performance of network models improves substantially with increasing sample size and when using methods that combine information from multiple indicators per node. Second, we use empirical data from the STAR*D trial (n = 3,731) to further evaluate the impact of measurement error. In the STAR*D trial, depression symptoms were assessed via three questionnaires, providing multiple indicators per symptom. Consistent with our simulation results, we find that when using sub-samples of this dataset, the discrepancy between the three single-indicator networks (one network per questionnaire) diminishes with increasing sample size. Together, our simulated and empirical findings provide evidence that measurement error can hinder network estimation when working with smaller samples and offers guidance on methods to mitigate measurement error.